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(54) Tiac: MEIHOD AND APPARATUS FOR REAL-TIME TRACKING OF RETAIL SALES OF SELECTED PRODUCTS 



(57) Abstract 

A system for generating 
timely sales perfwinance reports 
based on sales data recorded at 
point-of-sales (POS) termmals 
(14) in multiple stores (10) and 
transmitted to a central data 
processmg site (18) on a periodic 
and frequent basis. Taig^ items 
sold in each retafl store are 
detected by &eir unique product 
codes and data records pertaining 
to tiiese sales of target items are 
captured at the store, for transmittal 
to the central processmg site. 
The data records are **cleaned" 
(34) to reduce the occurrence of 
anomalous or enoneous data, 
and consolidated into a relational 
database (40) that can be queried 
by users to obtab various sales 
performance reports. Ibe database 
contains standard measures of sales 
performance derived from ttie data 
collected and the npnts permit 
users to assess the effectiveness of 
a sales promotion, and to obtain 
early warning of distribution voids 
indicative of inventory or stodcing 
problems. 
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METHOD AND APPARATUS FOR REAL-TIME 
TRACKING OF RETAIL SALES OF SELECTED PRODUC15 

BACKGROUND OF THE INVENTION 

5 

This invention relates generaUy to systems for processing retail sales data 
and, more particularly, to systems for using retaU sales data gathered at the point of sale 
(PCS) for purposes of inventoiy control and performance analysis. There has long been 
a need in the retail sales business for a more emcient approach to inventory control, 

10 especially for items that are delivered directly to stores from specialty suppliere. These 
direct store deUveiy (DSD) items, such as soft drinks and ice cream, are typicaUy 
delivered to each store by the supplier, rather than through a retaUer central warehouse. 
Because many of these items are relatively fest moving, the retaUer and the supplier 
often face a difficult task in decidntg on the quantity of product to deliver to each store. 

15 The difficulty is compounded by the profusion of sizes and, in many cases, flavors for 
each product. TypicaUy, the retailer has no way to determine accurately how big the next 
day's shipment of, for example, ice cream should be, and the supplier may have to 
overstock each delivery truck and defer a final decision untU the truck reaches the store. 
The retailer or the suppUer truck driver can then take inventory and finalize the order. 

20 This is but one examp]s of an inventory comrol or restocking problem. 

Another nnportant consideration is the efficient use of shelf space in retail stores. Shelf 
space is a limited and, therefore, valuable commodity to retailers. If shelf space is 
allocated to a new product, which does not sell as weU as expected, the retafler would 
prefer to reaUocate at least some of the shelf space. Unfortunately, however, sales 

25 performance data for the new product may not become available for days, or even 
wedcs, after its introduction. 

Obviously, a high level of inventory causes inefficient shelf space utiliza- 
tion and increases product spoilage and customer remrns of spoiled items. Too little shelf 
space may mean lost sales because of out-of-stock conditions. One solution is to make 

30 more frequent deliveries, but this approach increases distribution costs and requires 
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highcr quantities of products in the distribution pipeline. Various systems have been 
proposed to provide inventoiy control uifonnation to the retailer. For example, the 
system disclosed in U.S. Patent No. 3,899,775 to Larsen discloses the use of multiple 
POS terminals from which sales data are transmitted to an in-store processor to provide 
5 management reports on items such as inventoiy, sales rates and checker productivity. 
Other patents suggesting tiie use of scanned sales data for inventoiy control are Harris 
(U.S. Patent No. 3,737,631). Gechele et al. (U.S. Patent No. 3,770,941), and 
Kawashima et al. (U.S. Patent No. 5.168,445). 

These and other proposed similar systems focus on inventoiy control from 
10 die retaUer's perspective, providing a retaUer witii a historical view of what sold in tiie 
not-too-recent past and, tiiereforc, what to order in die fimirc. Such systems do not 
accurately reflect die customers' desires and usually result in too many of die wrong 
products and too few of die right products being in die store at any given time. 

Alfliough POS product scanning systems have been installed in retaU stores 
15 for some years, diere has been no way, prior to tiie present invention, to utilize die sales 
transaction data m such a way as to provide timely and useful sales performance analysis 
'^'^ 9^ ^iffiailty has been fliat die sheer mass of data 

gatiiered at laige retaU stores has acted as a deierrem to die development of efficient 
tools of diis type. There are tens of diousands of package goods manufactorcrs seUing 
20 products to several hundred food retaUers at diousands of retaU store locations. It is 
difficult, and often impossible, for a mamifactarer to obtain perfbimance infbnnation 
from hundreds of retailers about die sales performance of a single product of interest. 
A report widi such mfoimation, if available at all, is likely to be several weeks old and 
may contain significant errors. Details diat would be useful to die manufectorer, such 
as die identity of low-vohune stores widi respect to a particular product, may be missing 
from die report. 

Ideally, what is needed for efficient inventoiy control is a system diat 
meets diree related goals: satisfymg die customer by coirecdy anticipating customer 
needs, satisfying die retailer by maintaining die needed products in stock wifliout 
30 inefficient use of shelf space, and satisfying die manufatturer or distributor by providing 
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a cost-effective way for the needed products to be distributed. The present invention is 
directed to these ends. 

SUMMARY OF THE INVENTION 

5 

The present invention resides in a method and related apparatus for 
creating and maintaining a database of retail sales transactions, based on sales data 
transmitted from store locations on a periodic and fiequent basis. Briefly, and m general 
terms, the method of the invention comprises the steps of monitoring store computer data 

10 relating to sales transactions in multq)le retail stores; c^miring target sales data 
pertaining to sales of at least one preselected target item in each of the multq)le stores; 
periodically transmittmg the cq)tured target sales data to a data processing site; receiving 
the transmitted data at the data processing site; integrating the received data into a 
database; and generating a selected sales performance report from the database in 

15 response to a user query. 

More specifically, the captured target sales data transmitted to the data 
processing site includes, for each target item, store idenUfication data, a record of the 
current date, a code uniquely identifying the target item, data indicative of the number 
of these target items sold, and data indicative of the total amount spent on the target 

20 item. In the preferred embodiment of the invention, m^od further comprises the 
steps of deriving various standard measures of sales performance fixmi the target sales 
data received at the data processing site; and using selected ones of the standard 
measures of sales performance in the step of generating a selected sales performance 
report. Also in the preferred embodiment, the step of monitoring the store computer data 

25 includes passively receiving data firom a store communications loop cormecting multiple 
point-of-sale (POS) terminals at the store; and the step of capturing target sales data 
includes checking item sales records for presence of an item identifying code that 
matches diat of a target item and, if a match is found, saving the sales record relatiiig 
to the matching item. 

30 The step of generating a selected sales performance report includes 
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possible steps of generating various specific reports. Some of these steps include 
generating a distribution void report that identifies stores at which a target item has not 
been sold during a selected reporting period; generating a distribution void summary 
identifying potential under-stocking problems that result in lost sales; generatmg a 
5 potential out-of-stock report based on sales of a target item being below a baselme sales 
level by more than a preselected percentage; generating an order assistance report to 
assist m placing replenishment orders based on actual sales of a target item in relation 
to short-term sales projections; generating a list of target items and associated stores at 
which the sales price of the item has been lowered by more than a preselected percentage 

10 below a previously established base price; or generating a mffirhanrfiying effectiveness 
leport indicative of improvement in selected standard sales performance measures in 
response to a promotion lowering the price of a target item. 

In terms of novel apparatus, the invention may be defined to comprise 
means for monitoring store computer data relating to sales transactions in multiple retail 

IS stores; means for capturing target sales data pertaining to sales of at least one preselected 
target item in each of the multiple stores; means for periodically transmitting the 
captured target sales data to a data processing site; means for receiving the transmitted 
data at the data processing site; means for integrating the received data mto a database; 
and means for generating a selected sales performance report from the database in 

20 response to a user query. The invention may also te defined in apparatus terms of 
varymg scope similar to that used above in defining the invention as a method. 

It will be appreciated from the foregoing that the present invention 
represents a significant advance in the field of retail sales performance analysis and retail 
sales inventory control. The invention provides extremely timely reports of sales 

25 performance of selected target items, based on currently observed sales transactions 
rather than historical data. Therefore, manufacturers can make informed decisions 
involving the timely restocking of items to mimmize lost sales in retail stores, and 
pertaining to the effectiveness of sales promotions. Other aspects and advantages of the 
invention will become apparent from the following more detailed description, taken in 

30 conjunction with the accompanying drawings. 
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BRDSF DESCRIPTION OF THE DRAWINGS 
FIGURE 1 is a block diagram providing an overview of the pteseot 

invention; 

5 HG. 2 is a block diagnun Ulustrating the major components involved in 

data capture at retail store sites; 

HG. 3 is a flow diagram showing the functions performed in capturing 
sales data at the store sites; 

FIG. 4 is a flow diagram providing an overview of the data production 

10 process; 

FIG. 5 is a flow diagram depicting die data cleaning process; 
FIG. 6 is a flow diagram depictmg the data baselining process; 
FIG. 7 is a flow diagram depicting the distribution void application; 
FIG. 8 is a flow diagram depicting the application for producing distribu- 
15 tion void summary reports; 

HG. 9 is a flow diagram depicting the potential out-of-stock application; 
FIG. 10 is a flow diagram depicting the order assistance application; 
HG. 11 is a flow diagram depicting the price check application; and 
FIG. 12 is a flow diagram depicting die merchandising effectiveness 

20 application. 
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DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Overview: 

As shown in the drawings for purposes of illustration, the present 
invention pertains to a method and system for providing timely reports for use in sales 
performance analysis and inventory control, based on sales transaction data gathered 
from retail stores. Various attempts in the past to provide reports of this general type 
have not met the needs of customers, retailers and manufecturers. particularly 
manufecturers that deliver products direcdy to retail stores. 

In accordance with the present invention, sales transaction data for 
selected products are gathered in real time at point:K)f-sale (PCS) terminals in thousands 
of retail stores, transmitted ttirough communications links to a central site, and stored 
in a database. CUents or users, who are typically produa manufecturers. can access the 
database through conventional computer terminals and obtain timely reports nUting to 
15 sales of q)ecific products. 

HG. 1 shows the flow of data among tiie various components in 
accordance with tfie invention. Multiple store locations, indicated by reference numeral 
10. each have a data capture computer 12 connected to a conventional store processing 
loop 14. as will be discussed m more detaU below. The data capture conqniter 12 is 
separate from and independent of a conventional store controUer (not shown) used to 
control multiple POS terminals in a store. In a conventional PCS system, all of tiie data 
sensed by scanners at the terminals is transmitted along a communication path referred 
to as the store loop. The data capdire computer 12 is connected to the store loop data 
flow, as mdicated at 14. m such a manner as to passively collea data pertaining to each 
transaction at each POS terminal. Sales data are collected and written into a data storage 
device 16 when specific items are scanned at the POS terminals. Each product or item 
is recognizable by its unique bar code, referred to as tiie uniform product code (UPQ, 
printed on the product package. 

The collected data records m the data storage device 16 are periodicaUy 
transmitted to a store data collection center 18 over a communication path 20 that may 



20 



25 



30 



WO9a30201 m m pcT/DS95«)5374 



-7- 



10 



take the fonn of a telephone line with appropriate modems (not shown) connected at 
each end. Dependmg on details of design, the data may be transmitted daUy, houriy, 
every few minutes, or even very few seconds. At the store data coUection center 18, the 
transmitted data records are received by a store communication computer 22, which 
passes the received data to a store database computer 24, which, in turn, accumubtes 
the received data in a targeted UPC data storage device 26. The store communication 
computer 22 also transmits control mfonnation to the store data capture computers 12. 
In particular, the store communication counter 22 sends updates to a target UPC list, 
contained in ffles 28 at the store data coUection center 18. The target UPC list defines 
those items for which data wiU be canned at the store locations 10. There may be one 
or more store data collection centers 18. each of which comnnmicates with a smgfe data 
production center 30, tiirough a production center communication conpiter 32. The 
communication ludc 33 between tiie store data coUection center 18 and die data 
production center 30 may also be a telephone Une. or may be part of network of 
15 interconnected conqniters. Communication over tiie communication links 20 and 33 may 
optionally inchide data compression and decompression steps, to speed up the 
transmission time, and may also mchide appropriate encryption and decryption steps for 
security purposes. DetaUs of implementation of data compression and encryption are not, 
however, witiiin the scope of the present invention. 

20 "I^ data pnxhiction colter 30 inchides a data cleaning and prqMDcessuig 

computer 34 and a database bmlding computer 36. The data cteamng and preprocessmg 
computer 34 performs a desirable, although not absolutely necessary step of filtering the 
data for anomalies and errors. The various processing steps mvolved in data cleanmg and 
preprocessmg are fimher discussed below. After preprocessing, die data may be stored 

25 temporarily in a processed data storage device 38. from which the data records are 
retrieved by tiie data buUding computer 36 and mtegrated hito a cumulative database 
containing all tiie collected and preprocessed dau from aU die stores and pertaming to 
all tiie items for which data has been captured. Incoming data will be held m tiie 
cumulative database 40 for some selected time period before being routinely purged from 

30 die system or archived for ftiture analysis. 
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As will be further discussed below, the cumulative database is preferably 
managed by a commercially available relational database system permittrng easy access 
and manipulation of the database records. Access to the database by users is afforded 
dirough a client con^uter 44 at a remote site. The client con^ter 44 communicates 
S with a report generator computer 46, which, in turn, accesses the database 40 and 
generates timely reports for display or printing at the client computer site. 

The functions mentioned in this overview will now be discussed in more 
detail. It will be understood, however, that the separate computers referred to in the 
description are for purposes of illustration. Some of the functions described may be 
10 performed equally well in a single processing unit operating in a time-sharing or multi- 
tasking mode. 

Store Site Data Captmre: 

As shown in FIG. 2, a ^ical store has midtiple scanners SO and 

15 corresponding POS terminals 52. These are connected through the communication loop 
14 to a store POS controller 54, as is conventional. To cs^mire data for use in 
accordance with the invention, a loop attachment device 56 passively monitors data on 
the store loop 14 and transmits the data to the data capture computer 12. The latter 
contains, in hardware or software form, transaction logging logic 58. The data capture 

20 computer 12 operates in conjunction with the data storage device 16, which may be a 
disk drive or otiier mass storage device. The data storage device 16 contains a tracking 
target file, i.e., a list of all die "target* items for which data will be collected for 
purposes of the invention, and a product movement data log file, in which item-level 
sales transaction records are recorded for all product sale items detected by the POS 

25 terminals via the loop attachment device 56. In the system as illustrated, the data capture 
computer 12 communicates tiirough a modem 60 and a communication Ime 20 to the 
store data collection center 18. Transmission of data records over line 20 is performed 
on a regular and periodic basis, such as every day, hour, minute, or shorter time. The 
transmission can be initiated on a timed basis from the data capture computer 12 or from 

30 the store communication computer 22 (FIG. 1). 
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The loop attachment device 56 is ^ically installed as a circuit board in 
an expansion slot of the data capture conQmter 12, which may be a conventional personal 
computer. The device 56 operates passively, i.e. it does not transmit any data onto the 
store loop 14 and does not, therefore, interfere with normal operations of the store loop, 
5 the scanners 50 or POS controller 54. The loop attachment device is not, however, non- 
invasive, because direct electrical connections are made to the loop. Non-invasive store 
loop monitors are subject to errors because of electrical interference with the detected 
signals. The design details of the loop attachment device 56 depend on the particular type 
of store POS controller networic employed and on other factors. For exan5)le, specific 

10 terminal nodes for the system may need to be defmed and interfaced with the store POS 
controller 54, a simple network access may be all that is needed. Some POS systems 
allow an asynchronous communications protocol that enables a simple serial iqiut port 
of the store controller 54 to be used as the store loop attachment device. 

The functions performed in the data capture computer 12 at each store in 

IS logging data to the data storage device 16 are shown in more detail in FIG. 3. Data 
input, mdicated by block 64, is obtained from the store loop and first checked to 
determine if it contains UPC data, as indicated in block 66. (Other types of data are also 
detected and read from the store loop.) If a UPC data record is detected, the next 
question posed by the processing logic (in block 72) is to determine whether this UPC 

20 item is already in a list created for the current customer transaction. If the UPC is 
already in the list, a list entry for tte UPC needs only to be updated, as indiratpd in 
block 74, and then a return is made to the wait state to await interruption to process any 
subsequently received data (block 76) to await the next data irput. If the item is not in 
the list, it is added to the list, as shown in block 78, before returning to the wait state. 

25 If the data ii^t is not UPC data, as determined in block 66, a test is 

made (in block 80) to determine if it is "tender data," i.e., data relating to the tendering 
of payment by a customer. Detection of tender data is used to determine the end of a 
transaction. If the ixspai data is not tender data, the computer returns to the general wait 
state, as indicated in block 82. When a tender data record is detected, the items in the 

30 product movement list are logged to the log file on storage device 16, as indicated in 
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block 84, and are then cleared from the list, as shown in block 86 in preparation for 
processing the next transaction. Then the computer returns to the general wait state, as 
indicated in block 88. 

It will be understood that the processing steps described with reference to 
5 FIG. 3 have to be performed for all POS terminals in the store simultaneously and, 
therefore, the programming logic involved is somewhat more complicated than ttiat 
shown in the figure. Conventional programming techniques involvixig mtilrifaji^iring or the 
use of re-entrant code may be employed to achieve execution of the processing steps of 
FIG. 3 for all POS terminals simultaneously. 

10 

Transmission of Data from the Store: 

Either on a real-time basis or at regular selected intenrals, retail sales 
transactions are summarized (e.g., by UPC, time, lane, etc.) and formatted by the data 

15 capture conqmter 12, in accordance with progranmied instructions contained in the 
random access memory (RAM) of the computer, and transmitted to the store data 
collection center 18 (FIG. 1). In a presently preferred embodhnent of the invention, 
communication between the data capture computer 12 and the store data collection center 
18 is by means of a conventional modon 60, using dial-up or switched network 

20 telephone lines for the conununication link 20. During a communications session between 
the data capture computer and the store data collection center 18, data conespondixig to 
actual item level retail sales transactions are tiploaded to the data collection center. 
During the same session, the data collection center may remotely update or change the 
operating program stored in the RAM of the data capture computer 12, and may perform 

25 testing, as desired. 

In the presently preferred embodiment of the invention, periodic 
conununications sessions are scheduled and initiated by the store data collection center 
18. Once a session has been established, the data capture computer 12 issues commands 
to upload the sales data that it has logged since the last communications session. 
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Record Format for the Transmission File: 

The data transmission from the store locations has the followhig four 
possible record formats for transmission to the store data collection center 18 ui the 
presently preferred embodiment of the invention. One format is an item-level format for 



5 each UPC; one is a sunmiaiy format for transmitting totals; and the other two are special 
formats for transmitting information pertaining to situations in which the data capture 
system is moperative for some reason. More speciflcally, the record formats are: 



Iccc 


isss 


mniddjfyyy 


hhnunss 


LLL 


uuuuuuttummu 


##### 


cccccccc 


tttu 


dcscr^ttkm | 


ccc 


ssss 


mmddyyyy 


hhmmss 


LLL 


999999999999 




yy$s$stt 


ooooo 




ccc 


ssss 


mmddyyyy 


hhmmss 




999999999998 






rrr 


mson up D 


|cce 


ssss 


mmddyyyy 


lihmmss 




999999999997 






r r r 


rcison down || 



where the symbols in the format luive the following meanings: 



ccc 




a three-digit store chain number. 


ssss 




a four*digit store number (within a store chain). 


mmddyyyy 




the current date (month, day and year). 


hhmmss 




the time of the transaction (hour, minute, second) if applicable. 


LLL 




the lane mimber in the store checkout if applicable. 


UU...UU 




a twelve-digit UPC (with leading zeros if necessary). 


Hum 




the number of items sold with this UPC 


cccccccc 




the total amount in cents spent on the UPC item. 


ttttt 




the total number of transactions seen contauung this UPC, 


description 


= 


18-characters containing either: 



description for a new or changed price look-up (FLU), 
25 all hyphens for PLUs whose descriptions have not changed, 

all blanks for PLUs whose descriptions are utiknown at the store. 
The second, third and fourth alternative formats shown above contam special "UPC 
codes. When the code is all 9*s, the record is a summary record and the other fields 
other than the store identification and date fields carry the meanmgs: 
30 $$$$$$$$ » total sales rounded to the nearest dollar, 
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ooooo = number of onters. 

When the "UPC" code is 999...998. the other fields have the nuanings: 
rrr = a code indicating why the system went up, 

reason up = 18-character descrqption of why die system went up. 
Similarly, when the "UPC" code is 999...997, the other fields have the meanings: 
hhmmss = die time the sy^em when down, 
rrr = a code indicating why the system went down, 

reason down = 18-character reason why the ^ston went down. 

The system-up/down data records permit ^ropriate allowances to be 
made in subsequent processing if the data capture system is out of operation for some 
reason. For example, if the whole store system is down for an hour, presumably no data 
has been lost, but if the data capture computer alone is down, there may be a temporary 
inability to captorc sales data peitainmg to targeted items, and it may be necessary to 
inieipolate from available data, or at least to draw the user's attention to the lack of raw 
IS data. 

It wiU be understood that the sequence m which die fields q)pear in the 
data record shown above is not critical to the invention. Moreover, modifications may 
be made to the choice and length of the fields mcluded in the raw data transmitted to die 
data collection center. 



10 



20 



25 



30 



The Data Plroduction Process: 

Data production, as indicated within block 30 of FIG. 1, is the process 
whereby raw captured data records gadiered from die store POS scanners are cleaned 
and preprocessed. and dien integrated into die cumulative database 40. Some of the steps 
of cleaning and preprocessing are more desirable dian necessary, but arc described here 
for completeness. An overview of the data production process is piovided in HG. 4. 
Input to die process is obtained by reguhu- data transmissions from the stores, m die 
form of scanner level transaction files, as indicated at 90. These data records arc handled 
by die data production process eidier at an item level of selection, or a store level or 
selected store grouping level, as indicated m block 92. Hie data cleaning and 
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preprocessing functions are shown only generally in block 94. The steps, which are 
further discussed below, include data cleaning, "baselining," quality control at various 
levels, and required data translation. After this preprocessing, the data records are stored 
as a store transaction database 96 in the processed data storage device 38 (FIG. 1). This 
5 transaction data base is then used to buOd, as indicated m block 98, the cumulative 

database 40 used to respond to queries and generate reports. Building tiie database 40 
involves deriving various standard performance measures from die store transaction data, 
as will be explaii^d below. 

The database 40 is accessed by users 100 through a database user interfece 
10 program 102, which, in turn communicates with the database through a database 
interface module 104. The database 40. and die necessary software components to buUd 
it (98) and to access it (102 and 104) may utilize commeicially avaUable relational 
database software, such as Oracle release 7.1 and widi Forms release 4.0. by Oracle 
Corporation. 500 Oracle Parkway, Redwood Shores. California 94065, SYBASE SQL 
15 Server by SYBASE 6475 Christie Avenue. EmeryviUe. California 94608. or ON-LINE 
by INFORMIX 4100 Bohanon Drive, Menlo Park, California 94025. TTie mvention is 

presenUy nnplemented usmg date structures comistem with a database system marketed 
under tiie name EXPRESS by Information Resources. Inc. of Chicago. Illinois. TTie 
database created using EXPRESS formats is caUed an INFOVIEW database. Hie 
20 database user interfece program 102 used to acass is DataServer, which is available for 
license from the same conqnny. The database interface module 104 for DataServer is 
known as die DataServer Bridge Companion. The specific software used to build and 
access die database 40 is not critical to die mvention. 

25 Data Cleaning: 

Data cleaning is simply a process of filtering die raw transaction data to 
eliminate or compensate for possible anomalies and errors. Some of die reasons for data 
cleaning do not apply when data records are processed in daily or more frequent batches. 
When reports used to be available only on a weekly or longer basis, tiiere was a risk diat 

30 stores would contribute cumulative sales figures diat would distort die apparent sales 
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performance of a product. With daily or closer to real-time data gathering, cleampg to 
remove anomalies of this sort is, for the most part, unnecessary. Cleaning is also used 
to compensate for errors mtroduccd by possible ambiguities of some transactions. For 
example a six-pack of a beverage might be recorded as one unit at one price or as six 
5 units at a different price. Since some of the standard measures of performance involve 
numbers of units (e.g. number of units moved (sold) or average price per unit), it is easy 
to see how different reports might be generated depending on how the sales transactions 
were recorded. 

In addition to errors arising from multi-pack transaction handliiig, there 

10 are a number of other known classes of errors in sales transaction data. These error 
classes mclude: bad prices (errors in retailer price files), no prices (retailer omissions), 
bad volume reporting (errors in retailer data processing), data alignment problems 
(misalignment of sales data with wrong price structure), missed data (field data collection 
omission), duplicate or low data (data transmitted twice or incomplete), missing PLU 

15 codes, and key items missing from data records. It will be apparent tfiat msmy of the 
classes of errors on this list are eliminated in the mvention because the sales transaction 
^ ^^^.^^ °° frequent basis at the point of sale, so there is less chance 

of errors in reporting by retailers. Of course, some ^pes of errors remain a problem in 
the present invention as well, and it is desirable to elimmate or reduce them wherever 

20 possible. However, it will be ^preciated that, because many types of errors and 
anomalies are inherenfly elumnated by use of the invention, data cleaning is not quite 
the necessity that it would be without use of the invention. 

The basic functions of data cleaning are ilhistrated in FIG. 5. First, store 
transaction data 110 are processed tfirough a function 112 tiiat detects any PLU (price 

25 look-up) codes fliat need to be translated. Price look-up codes are store-specific codes 
used on some items, and they need to be translated to corresponding UPC designations 
before entry into the database 40. Block 114 describes a dictionary function tiiat is next 
performed to check for several possible anomalies. Specifically, the price of tiie item is 
checked for legitimacy. Also, any multiple records for a single UPC arc combined into 

30 a single sales record. FinaUy, the dictionary is used to perform "fflCONE" processing. 
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an example of which is the ambiguity between the two ways of iecoidh« a mulU-pack 
item. To perfbim the dictionary funcUons. the system maintains a dictionaiy of every 
item (by UPO that has ever been sold in any of the stores. The dictionary contains 
information about the category, mamifecturer, brand, size, multi-pack handling, and 
multiprice handling (if applicable), as weU as various attributes of the product, such as 
flavor ,style and so forth. After processing through the dictionary, the lesuhii^ data 
records are more logically consistent and better suited for the type of processmg that is 
to follow. 

Another level of data cleanmg is store-level quality control (block 116), 
whereby the sales data records for each store are checked for stoie-Ievel data problems, 
such as an excessively high or excessively low volume for a particular store. TTiis 
processing step computes as many as diirty-two distinct measures of price, vohnne, • 
product promotion, inchision of major products, inclusion of major vendors, and pixxfaict 
movement distribution. The various measures are compared with each other for 

comistency and are compared with historical data for the same store. The systOT 
one of its goals the identification of corrupt files at the store level, but it does so without 
tripping fake alarm signals that might otherwise be caused by normal anomalous events, 
such as public holidays or store promotions. 

The next level of data cleanmg is to fanpute records to fill m data gaps left 
20 by stores with bad or missing data, as indicated in block 118. As mentioned above with 
reference to the data record formats, a data record is transmitted by each store whenever 
the store processing system goes down or comes back up. This ^ of data gap is filled 
by an inteipokition process. Smiilariy, data records identified as bad may be replaced or 
modified. In block 120, the data cleaning process examines the sales history for each 
25 UPC across all stores, and identifies any apparent anomalies. 

Finally, the . ita cleaning process may inchide die abUity not only to check 
for bad data, but to suggest solutions and causes of data problems, as indicated m block 
122. Agam. this level of complexity m the data cleaning and preprocessing steps is not 
beUeved to be necessary for the present invention ra its broadest form, but may desirable 
30 in some situations. 
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Baselining: 

Baselining is a tenn used to describe a process of determining expected 
product performance in the absence of promotional activity. FIG* 6 shows the principal 
functions performed m baselinmg for the present invention. Collected store data records 
5 that have appropriately cleaned, mdicated at 130. are processed through a first baselmmg 
process 132, which is concerned with baselimng the data at the product (UPQ level by 
store, and through a second haselme process 134, which is concerned with baselinh^ of 
total store sales and transaction volume. 

In product-level baselming of product performance (as measured by 

10 selected "standard measures," to be described) it is first determined if there has been 
promotional activity (signified by a price decrease of, for example, greater than five 
percent), as mdicated m block 136, If promotional activity is detected for that product, 
the existing baselme is carried forward without change, as indicated in block 138. In 
either case, the product performance is seasonally adjusted accordmgly, as indicated m 

15 block 140. Then the seasonally adjusted record is further adjusted jfor a day-of-week 
effect, as mdicated in block 142. Finally, if there is promotional activity, the adjusted 
record is accumulated iirto the baseline performance measure on a rolling average basis, 
as indicated in block 144. 

Total store sales and transactional volume baselining involves a similar set 
20 of process steps, except that the data measures being processed are different ones. In 
block 146, performance is checked against an existing baseline for promotional activity. 
If there is promotional activity, the existing baseline is carried forward (block 148). If 
there is no promotional activity, the performance measures are adjusted for season (block 
150) and day-of-week effects (block 152). and then accumulated into the baseline 
25 measures on a rolling average basis, as iiKlicated at 154. 

Standard Measures of Performance: 

Standard measures of performance are sales performance parameters 
derived by arithmetic manipulation of the raw data records imported from stores and 
30 cleaned as necessary for a given ^plication. The standard measures become part of the 
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cumulative database 40 and are then avaflable in response to queries from usere. For 
completeness, the standard measures arc described below: 



5 Unit Ssies 
Volume Sales 



10 Dollar Sales 



Average Price per Unit 

15 

% Units with Any Price 
Reduction 



20 Avg. Base Price per Unit 



25 



Base Volume (Units) 



30 



Pescription 

Sales expressed in physical units for a produa within a 
specific time period and set of stores. 
Sales converted to an equivalent volume (e.g., cases, 
gallons, etc.). Volume sales arc obtamed by multiplying a 
product's Unit Sales by a predetennined conversion factor. 
Sales expressed in dollars scanned at checkout for a 
product within a specific time period and set of stores. 
Tenq>oraiy price reductions set by in-store trade deals are 
taken into account, but discounts due to coupons arc not. 
Dollar sales divided by Unit Sales scanned at checkout for 
a product. 

For a set of stores within a given tnne period, this measurc 
provides ttie proportion of a product's Unit Sales with any 
in-storc temporary price reductions. This measure does not 
include coiq>on activity. 

The Base Price is the unit price that would be expected 
during a "non-merchandized* (i,e. no tenq>orary price 
reduction in effect) periods. The Base Price is updated 
when a price change is in effect for sbc consecutive weeks . 
Base Vohmie is an estimate of what a product's volume 
Sales would be m absence of an in-store deal with a 
temporar price reduction. Base Volume is used to 
determine the effectiveness of trade promotions aiKi 
provide short-term forecasts for product replenishment. If 
no equivalency is specified. Base Volume is expressed in 
units. 
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10 Incremental Dollars 



Items Moved 



15 



20 



25 



30 



Base Dollars Base Dollars is an estimate of what a product's Dollar 

Sales would be in absence of an in*store deal with a 
temporary price reduction. Base Dollars is the difference 
between Dollar Sales and Incremental Dollars. 

Incremental Volume (Units) The difference between Vohmie Sales and Base Volume is 

Incremental Vohmie. Incremental Volume represents 
additional volume sold due to a temporary price reduction. 
If no volume equivalency is specified. Incremental Volume 
is expressed in imits. 

Incremental Dollars represents additional Dollar Sales due 
to a temporary price reduction. This measure can take on 
negative vahies if a price reduction does not result in 
sufficiently higher Volume (Sales). 
Indicates how many different items (different UPCs) were 
sold. The Items Moved measure definition depends on the 
type of aggregation specified: 

(1) For pre-produced geographies (geographical areas) and 
time periods, the measure indicates how many constituent 
UPCs sold at least one unit of the specified product. 

(2) For custom (preselected) time periods, the measure 
yields the maximum of the daily Items Moved for a 
product. 

(3) For custom market aggregates, the measure yields the 
average number of Items Moved per store for a product. 

(4) For custom product aggregates, the measure yields the 
sum of the Items Moved for the constituent products or 
UPCs, 

(1) For pre-produced geographies and time periods, this 
measure yields the proportion of stores selling at least one 
unit of the specified product. 



% Store Selling 
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% Stores w/Any Price 
Reduction 



10 



15 



20 



25 



30 



(2) For custom time aggregates, Uiis measure yields the 
maximum of the daily % Stores Selling for a product. 

(3) For custom maricet aggregates, diis measure yields the 
actual % Stores Selling. 

(4) For custom product aggregates, this measure yields the 
maxfanum of the % Stores Selling for the constituent 
products or UPCs. 

(1) For pre-produced geographies and time periods, diis 
measure yields die proportion of stores supporting a 
temporary price reduction for the specified product. 

(2) For custom time aggregates, tiiis measure yields the 
maxfanum of the daily % Stores for a product. 

(3) For custom market aggregates, this measure yields die 
acdial % Stores. 

(4) For custom product aggregates, this measure yields die 
maxfanum of the % Stores for tiie constiment products or 
UPCs. 

For products at the UPC level wily, tiiis measure yields tfie 
raw number of shoppers purdiasfaig the specified UPC. 
(No product aggregations above the UPC level are 
permitted for this measure.) 
Transactions/100 Shoppers For products at the UPC level only, diis measure yields the 

equivalent number of Omppexs purchasfafig tiie specified 
UPC per 100 store shoppers. (No product aggregations 
above the UPC level are permitted for tiiis measure.) 
This measure yields die average number of units purchased 
per buyer, derived by dividuig Unit Sale? by Transactions 
for a particular UPC. 

The Unit Sales per 100 store shoppers. A "store shopper" 
is defined as a shopper who makes aiiy purchase ui die 



Transacticms 



Units per Transaction 



Units per 100 Shoppers 
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store on a given day. This measure is used to conq)are a 
product*s sales pcrfonnance among stores by removing the 
impact of store traffic (i.e. shoppers). Similarly to units 
per dollar ACV (all commodity volume). Units per 100 
Shoppers can be used as a measure of a product's velocity 
(Le., turns). 

The amount of Dollar Sales per 100 store shoppers. 
A measure used to mdicate effectiveness of trade promo- 
tion, % Unit Increase is derived by calculating the 
percentage increase in Unit Sales over Base Units during 
periods of in-store promotion with a temporary price 
reduction. 

The percentage increase in Dollar sales over Base Dollars 
during periods of m-store promotion with a temporary 
price reduction. % Dollar Increase can take on negative 
values if flie temporary price reduction does not result in 
sufRciently higher Volume Sales. 

Examples of User Applicatioiis: 

2^ As wUl be ^parent from Uie examples to be described, the application 

flow diagrams in HGS. 7-12 have a number of features in common, namely ttiose 
functions tiiat relate to collection and production of die database, to client/user selection 
of query parameters, and to generation of a displayed or printed report. These features 
wai be described only for the first of die examples (FIG. 7). Each example provides a 

25 specific technique for tracking die sales performance of a selected target item, or group 
of target items, for which data has been collected. 

IKstribution Void Application: 

The objective of ttiis application is to minimize lost sales by recognizing 
30 and diagnosing various problem stocking situations. When tiiere is no movement, i.e. 
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Dollars per 100 Shoppers 
% Unit Increase 



% Dollar Increase 
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sales, of a target item at a particular store, it is probable that the itsm is out of stock, 
mdicating a "void" in the distribution pattern for the item. The application gives clients 
the ability to track product distribution as it builds up through multiple retail sales outlets 
based on actual timely sales performance rather than from sample data projections. 

5 As indicated in block 160, target item data records are collected on a 

regular (e.g. daily) basis, and transmitted to the data production center, as indic>ated in 
block 162 and as described above with reference to FIGS. 1 and 2. The data records are 
subjected to cleaning and other preprocessing, as indicated in block 164; then target data 
over a selected tnne period are chosen for fiirdier processing of client queries, as 

10 indicated in block 166. The client selects a store or group of stores (block 170), and 
selects a target item or group of items (block 172). Finally, the client enters application 
parameters, if required, (block 173), pertinent to the application being requested. Then 
the search is made, as indicated in block 174, based on the client's input selections. 

For this application, the specific processipg involved includes a step of 

IS checking the target data for "zero movement** in the selected store or stores, as indicated 
in block 176. The search may continue (block 178) for additional selected target items 
or stores. Any zero-movement target item is incorporated into a client query database 
(block 180), since this is probably indicative of a distribution void. In the presently 
preferred embodiment of the invention a distribution void is defined as zero sales over 

20 the most recent fourteen days. Then, the retrieved data items are prepared for inclusion 
into a client report (block 182), for display (block 184) and possible printing (blocks 
186, 188), after which a return is made to a wait state (block 190). 

The report generated in this application not only identifies the distribution 
voids, but also indicates whether or not the produa has sold for the eight most recent 

25 seven-day rolling periods, for the stores that have the voids. This helps the user identify 
any potentially chronic problem stocking situations. The same tool also facilitates 
tracking of sales volume build-up for new products. 

Distribution Void Summary Application: 
30 FIG. 8 shows a related application for producing a distribution void 
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summaiy report. In processing this client query, the database system first examined each 
target item for movement (sales) at each store, as indicated m block 200. The system 
produces a query database of stores without target item movement (block 202) and a 
query database of stores with target item movement (block 204). Both query databases 
arc integrated into the preparation of the client reports, which may include any of the 
reports shown in the figure, such as % of stores selling at least one unit, units per 100 
shoppers, average base price, and so fordi. 

The Distribution Void Summary report ranks target products by "Potential 
Additional Dollars," suggesting potential sales gams if the specified product were 100% 

in stock. The purpose of the report is to provide a tool to evahiate stocking conditions 
quickly without having to perform physical audits of the inventory. In die presem 
implementation of the application, time periods arc limited to seven-day periods ftom 
Monday through Sunday. The repon uses the following key measures: 



% Stores Sellmg: 

% Store-UPC-Weeks 
Distribution Void: 



25 Base Sales: 

Units per 100 Shoppers: 
Average Base Price: 

30 



The percentage of stores selling at least one unit of the 
q)ecified product over all of die weeks selected. 

A measure which views distribution void rates in three 
dhnensions. For exanqile, a brand with 10 UPCs in 100 
stores over 4 wedcs has a total of 10 * 100 * 4 = 4,000 
possible selling sitoations. If one UPC did not sell in the 
total of 100 stores for4 weeks, thena total of 1 * 100 * 4 
«= 400 store-UPC-weeks had a void sidiation. The void 
rate would be 400/4,000 = 10%. This 10% figure repre- 
sents possible lost sales. 

An estimate of what sales wcmld be in absence of a 
temporary price reduction. 

The average units sold for every 100 shoppers over the 
^cified time period and set of stores. 
The average non-reduced (everyday) price over the 
specified time period and set of stores. 
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100% In-Stock 

Opportunity: What non-promoted (base) sales might be if the specified 

product had 100% storc-UPC-week distribution, calculated 
as follows: 

5 (Base Units * Avg. Base Price) /[!.(% store-UPC-weeks void / 100)1 

Potential Additional $: The uicrcmental dollar opportunity resulting from a perfect 

(100%) stockmg situation, calculated as follows: 
100 % In-Stock Opportunity - (BaseUnits * Avg Base Price) . 

10 Potential Out-of-Stock Application: 

In this application, the query processing inchides, as shown in FIG. 9. 
determinmg if the expected sales levels have been met for the target product or products, 
as indicated in block 210. A comparison is made between the actual sales (from scanned 
data) and abaseline sales level maintained in the database usii^ the baselming techniques 

15 discussed earlier. An out-of-stock condition is defined as occurring when the actual Unit 
Sales measure for a target item is less tiiat the Base Volume of sales by some selected 
percentage. Again, ttie assumption is that unusually low sales of a product are mdicative 
of a potentially low stock of that item, just as zero movement is used to identify an out 
of stock condition in the distribution void plication. 

20 

Order Assistance Application: 

In this application, ^wn m FIG. 10. recent period actual sales are 
compared with short-term base forecasts in order to develop order requirements, as 
indicated in block 220. the order requirements are stored (block 222) and uicorporated 
25 into client reports, which may mclude order requirements by total quantity, by UPC or 
by store location (block 224), or direct store delivery vendors replenishment orders 
(block 226). or electronically transmitted reports to control truck loading and routing to 
stores (block 228). 



30 
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Price Check Application: 

In this application, shown in FIG. 11, an exception-based report is 
generated showing the price decreases by store and UPC over a selected time period. 
Only those UPCs and stores that had a price decrease greater than 5% coiiq>ared to the 
5 base (everyday) price are mcluded in the report. A manufecturer may use the report, for 
example, to monitor store prices when a reduced-price promotion is in effect. A target 
item is checked for a price diange (block 230) and, if there has been a price chaiige, a 
query database of price changes is updated (block 232) for presentation in a report to the 
client making the query. The key measures used in the rqx>rt generation are Actual Price 
10 and Base Price. 

Merchandising Effectiveness Application: 

Another unportant application is to analyze the effectivei^s of promotions 
of target items in various stores. The effectiveness is determined on a selected 
percentage improvement in a performance parameter, such as Unit Sales or Dollar Sales 
over a selected period. The key measures used in determining effectiveness include base 
price, actual price, base units, incremental units, % unit increase, % price decrease, and 
incremental dolku?. Stores meeting die effectiveness criteria, as determined in block 
240, are sorted and ranked based on their performance in the sale of the target pitxfaict, 
as indicated in block 242. Stores are sorted into those non-responsive to the promotion, 
as determined in block 244, and those responsive to various selected levels, as 
determined in block 246. For example, the stores may ^arated into categories of 
"highly responsive,** "moderately responsive** and ''responsive.*' A query database is 
generated, as indicated in block 248, for display and printing for the client making the 
query. 

Summary: 

It will be appreciated from the foregomg that the present invention 
represents a significant advance in the measurement of sales perfomumce, for purposes 
30 of both performance analysis and inventory control. An important aspect of the invention 
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is that it provides timely reports based on sales data lecoids of which the most recent 
are no more than a day old. As fester communication technology becomes more readily 
avaUable. sales data records may be accumulated in a real time mode, so that potential 
out-of-stock conditions and problems with fiUfflling restocking orders can be detected 
5 weU m advance and corrected with appropriate shippmg mstructions. 

It will also be appreciated that, although a number of embodiments and 
configurations of the mvention have been described in detaU for purposes of Ulustration, 
various other modifications may be made without departing form the spirit and scope of 
the invention. Accordingly, the invention should not be limited except as by the 
10 appended claims. 
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CLAIMS 

!• A method for generating timely reports of sales 
of selected items in multiple retail stores, the method 
comprising the steps of: 
5 monitoring store computer data relating to sales 

trcinsactions in multiple retail stores; 

capturing target sales data pertaining to sales of 
at least one preselected target item in each of the multiple 
stores; 

10 periodically transmitting the captured target 

sales data to a data processing site; 

receiving the transmitted data at the data 
processing site; 

integrating the received data into a database; and 
1^ generating a selected sales performance report 

from the database in response to a user query. 

2 . A method for generating timely reports of sales 
of selected items in multiple retail stores, the method 
comprising the steps of: 
20 recording, in an in-store computer system at each 

of a plurality of retail stores, a list of target data items 
for which sales performance data reports are required; 

monitoring in each retail store data pertaining to 
sales transactions as they take place; 
25 capturing target sales data pertaining to sales of 

any of the items on the list of target items; 

periodically transmitting the captured target 
sales data to a data processing site; 

receiving the transmitted data at the data 
30 processing site; 

preprocessing the data to reduce the occurrence of 
erroneous or anomalous data records; 

integrating the received data into a database; and 
generating a selected sales performance report 
35 from the database in response to a user query. 
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3. A method as defined in claims 1 or 2, wherein: 
the captured target sales data transmitted to the 

data processing site includes, for each target item, store 
identification data, a record of the current date, a code 
5 uniquely identifying the target item, data indicative of the 
number of these target items sold, and data indicative of 
the total amount spent on the target item. 

4. A method as defined in claim 3, wherein: 

the sales data transmitted to the data processing 
10 site further includes a record of any time that the step of 
data capturing was inoperative for any reason; and 

the step of preprocessing the data includes 
interpolating to compensate for missing data records. 

5. A method as defined in claims 1, 2, or 3, and 
15 further comprising the steps of: 

deriving various standard measiires of sales 
performance from the target sales data received at the data 
processing site; and 

using selected ones of the standard measures of 
20 sales performance in the step of generating a selected sales 
performance report* 

6. A method as defined in claims 1, 2, or 3, 

wherein: 

the step of monitoring the store computer data 
25 includes passively receiving data from a store 
communications loop connecting multiple point-of-sale (POS) 
terminals at the store; £md 

the step of capturing target sales data includes 
checking item sales records for presence of an item 
30 identifying code that matches that of a target item and, if 
a match is found, saving the sales record relating to the 
matching item. 

7. A method as defined in claims 1, 2, or 3, 

wherein: 
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the step of generating a selected sales 
performance report includes generating a distribution void 
report that identifies stores at which a target item has not 
been sold during a selected reporting period. 

5 8. A method as defined in claims l, 2, or 3, 

wherein: 

the step of generating a selected sales 
performance report includes generating a distribution void 
summary identifying potential under-stocking problems that 
10 result in lost sales* 

9. A method as defined in claims 1, 2, or 3, 

wherein: 

the step of generating a selected sales 
performance report includes generating a potential 
15 out'-of-stock report based on sales of a target item being 
below a baseline sales level by more than a preselected 
percentage. 

10. A method as defined in claims 1^ 2, or 3, 

wherein: 

20 the step of generating a selected sales 

performance report includes generating an order assistance 
report to assist in placing replenishment orders based on 
actual sales of a target item in relation to short*-term 
sales projections. 

25 11. A method as defined in claims l, 2, or 3^ 

wherein: 

the step of generating a selected sales 
performance report includes generating a list of target 
items and associated stores at which the sales price of the 
30 item has been lowered by more than a preselected percentage 
below a previously established base price. 

12. A method as defined in claims l^ 2, or 3, 

wherein: 
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the step of generating a selected sales 
performance report includes generating a merchandizing 
effectiveness report indicative of improvement in selected 
standard sales performance measures in response to a 
5 promotion lowering the price of a target item. 

13. Apparatus for generating timely repoirts of 
sales of selected items in multiple retail stores, the 
apparatus comprising: 

means for monitoring store computer data relating 
10 to sales transactions in multiple retail stores; 

means for capturing target sales data pertaining 
to sales of at least one preselected target item in each of 
the multiple stores; 

means for periodically transmitting the captured 
15 target sales data to a data processing site; 

means for receiving the transmitted data at the 
data processing site; 

means for integrating the received data into a 
database; and 

20 means for generating a selected sales performance 

report from the database in response to a user query. 

14. Apparatus as defined in claim 13, wherein: 
the captured target sales data transmitted to the 

data processing site includes, for each target item, store 
25 identification data, a record of the current date, a code 
uniquely identifying the target item, data indicative of the 
number of these target items sold, and data indicative of 
the total amount spent on the target item. 

15. Apparatus as defined in claim 14, and fiirther 
30 comprising: 

means for deriving various standard measures of 
sales performance from the target sales data received at the 
data processing site; 
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and wherein the means for generating a selected 
sales performance report uses selected ones of the standeird 
measitres of sales performance. 

16. Apparatus as defined in claim 13, wherein: 
the means for monitoring the store computer data 

includes means for passively receiving data from a store 
communications loop connecting multiple point-of-sale (PCS) 
terminals at the store; and 

the means for capturing target sales data includes 
means for checking item sales records for presence of an 
item identifying code that matches that of a target item 
and, if a match is found, saving the sales record relating 
to the matching item. 

17. Apparatus as defined in claim 13, wherein: 
the means for generating a selected sales 

performance report includes means for generating a 
distribution void report that identifies stores at which a 
target item has not been sold during a selected reporting 
period. 

20 18. Apparatus as defined in claim 13, wherein: 

the means for generating a selected sales 
performance report includes means for generating a 
distribution void summary identifying potential 
under-stocking problems that result in lost sales. 

25 19. Apparatus as defined in claim 13, wherein: 

the means for generating a selected sales 
performance report includes means for generating a potential 
out-of-stock report based on sales of a target item being 
below a baseline sales level by more than a preselected 

30 percentage. 

20. Apparatus as defined in claim 13, wherein: 
the means for generating a selected sales 
performance report includes means for generating an order 
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assistance report to assist in placing replenishment orders 
based on actual sales of a target item in relation to 
short-term sales projections. 

21. Apparatus as defined in claim 13, wherein: 

5 the means for generating a selected sales 

performance report includes means for generating a list of 
target items and associated stores at irtiich the sales price 
of the item has been lowered by more than a preselected 
percentage below a previously established base price. 

22. Apparatus as defined in claim 13, wherein: 
the means for generating a selected sales 

performance report includes means for generating a 
merchandizing effectiveness report indicative of improvement 
in selected standard sales performance measiures in response 
15 to a promotion lowering the price of a target item. 
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